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Magnetic ordering at low temperature for Ising ferromagnets manifests itself within the associ- 
ated Fortuin-Kasteleyn (FK) random cluster representation as the occurrence of a single positive 
density percolating network. In this paper we investigate the percolation signature for Ising spin 
glass ordering — both in short-range (EA) and infinite-range (SK) models — within a two-replica 
FK representation and also within the different Chayes-Machta-Redner two-replica graphical rep- 
resentation. Based on numerical studies of the ± J EA model in three dimensions and on rigorous 
results for the SK model, we conclude that the spin glass transition corresponds to the appearance 
of two percolating clusters of unequal densities. 



I. INTRODUCTION 



Ising type spin glass models, both of the short-range Edward- Anderson (EA) and the infinite-range Sherrington- 
Kirkpatrick (SK) 2 varieties, have been studied for decades (for some recent reviews, see [3j and |4]). Nevertheless, to 
a large extent, they remain a mystery — especially the short-range variety, with competing views as to the nature of 
their ordered phases at low temperature T [31131 |S]. Indeed, from the perspective of rigorous results, it is striking that 
there is no proof of broken symmetry (e.g., of a nonzero EA order parameter) for any dimension d or temperature T. 

Graphical representations such as the Fortuin-Kastelyn (FK) random cluster model f6l [7j are important tools in 
the study of spin systems. They relate correlations in spin systems to geometrical properties of associated random 
graphs. Graphical representations are useful in obtaining rigorous results concerning spin systems (e.g., [Hlin])i they 
yield geometric insights into the nature of phase transitions and they are the basis for powerful Monte Carlo methods 
for simulating phase transitions [101 HU US]- However, graphical representations have, thus far, played a much less 
important role in the study of spin glasses than they have for ferromagnets. 

In this paper, we investigate two different graphical representations — the two-replica graphical representation 
of Chayes, Machta and Redner (CMR) [13l [14] and a two-replica version of the FK representation (see Sec. 4.1 
of |15j). Our purpose is to understand the "percolation signature" of spin glass ordering within these graphical 
representations. For ferromagnets, ordering corresponds to the occurrence of percolating networks or clusters in the 
single replica version of the FK representation. As we shall explain, we believe we have elucidated the somewhat more 
complicated percolation signature for spin glasses. 

This should help in understanding better the differences between the nature of the phase transition in ferromagnets 
and in spin glasses. It is also our hope that for short-range models, this will be a significant step towards developing 
a rigorous proof for spin glass ordering and eventually lead to a clean analysis of the differences between short- and 
infinite-range spin glass ordering. 

Understanding the percolation signature for spin glasses requires two ingredients beyond what is needed for ferro- 
magnets. The first is the need to consider percolation within a two-replica representation. As mentioned, we consider 
two different such representations — one is the percolation of a certain class of bonds (these are the "blue bonds" 
introduced and explained in Subsection 



is percolation of bonds that are doubly 



II B| below) in the CMR two-replica graphical representation and the other 



'K occupied — i.e., occupied in both replicas — in the two-replica Fortuin- 



Kasteleyn (TRFK) representation. The two different types of percolation, which we will often refer to simply as 
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CMR and TRFK percolation, give relatively similar (but not identical) results, with the major qualitative distinction 
occuring within the SK spin glass. 

The second ingredient, initially unexpected by us but in retrospect rather natural, is that spin glass ordering 
corresponds to a more subtle percolation phenomenon than simply the appearance of a percolating cluster — one that 
involves a pair of percolating clusters. In the case of a ferromagnet, there are general theorems [16 which ensure that 
when percolation occurs, there is a unique percolating cluster, whether in single or double replica representations. It 
is also possible (by averaging over disorder realizations) to show (see, e.g., [17\ and [TB]) that the same conclusions 
are valid in the single replica FK representation of spin glasses. However for blue bond percolation in the (two- 
replica) CMR representation of spin glasses, both our numerical evidence for the d — 3 EA model and our rigorous 
results for the SK model (in the CMR representation) show that at temperatures well above the spin glass transition, 
there already is percolation, but that there are two percolating networks which are equal in density (and presumably 
otherwise macroscopically indistinguishable). The SG transition corresponds to the breaking of indistiguishability 
between the two percolating networks — in particular by having a nonzero difference in densities. The latter feature 
also occurs for doubly occupied bonds in the TRFK representation of the SK model, except that in that representation 
there are no percolating networks at all above the transition temperature. 

From a numerical perspective, spin glasses also pose major challenges. Some of the numerical techniques, e.g., that 
of Swendsen and Wang (SW) [TTJ[18l[T9] based on graphical representations, such as that of Fortuin and Kasteleyn, 
which have proven so useful for ferromagnets [6l[7], are in principle applicable to spin glasses. However, they are very 
inefficient in practice for values of d and T where ordering is believed to occur. The CMR graphical representation 
is related to a two-replica algorithm originally introduced by Swendsen and Wang and developed by these and other 
authors [20l [211 [22l [23] . These authors have shown that algorithms incorporating two-replica cluster moves are 
somewhat useful in simulating spin glasses. In particular, Jorg [251 HSj has shown that an algorithm based on a two- 
replica representation performs reasonably efficiently for diluted spin glass models in three dimensions. Two-replica 
cluster methods have also been successfully applied to Ising systems in a staggered field and to the random field 
Ising model [24] . The Monte Carlo method that we use takes advantage of the full set of moves allowed by the CMR 
graphical representation. These moves are a superset of the moves used in [TTl [151 HM [^ [2^ [^ . 

The paper is organized as follows. In Sec. ITT] we introduce the idea of graphical representations, describe the CMR 



and TRFK two-replica graphical representations and present properties of these representations. In Sec. Ill we analyze 
both two-replica representations on the complete graph — i.e., for the SK spin glass. In Sec. |IV| we present numerical 
results for the three-dimensional EA model. The paper concludes with a discussion. 

II. GRAPHICAL REPRESENTATIONS FOR SPIN GLASSES 
A. Fortuin-Kastelyn Graphical Representation 

Graphical representations for the Ising model originated with the work of Fortuin and Kastelyn [SJ [7]. They 
were re-discovered and given a physical interpretation by Coniglio and Klein [25], applied as the basis of a powerful 
algorithm for simulating the Ising model by Swendsen and Wang [TTJ [TSJ [12] and then reformulated as a joint spin- 
bond distribution by Edwards and Sokal |20j . Edwards and Sokal introduced a joint distribution of spin variables 
{ax} and bond variables {tOxy}- Here {x} represents the set of sites (vertices) of an arbitrary lattice (graph) and 
{xy} the set of bonds (edges). The Ising spin variables take values ±1 and the bond variables take values or 1, or 
"unoccupied" and "occupied" , respectively. The statistical weight W for the Edwards-Sokal distribution is 

W(fT, uj; p) = pl'^l (1 - p)^"-!"! A(ct, lo) (1) 

Here — ^^v ^^e number of occupied bonds and Nf, is the total number of bonds on the lattice. The factor 

A(o', w) is defined by, 

A / \ f 1 if for every xy: Uxv = 1 ^ o-x^u = 1 /^\ 
^ ^ 10 otherwise ^ ' 

The A factor requires that every occupied bond is satisfied. Without the A factor we would have independent Bernoulli 
percolation. Given the choice, p = 7^fk(/3) = 1 — exp(— 2/3J), it is easy to verify that the spin and bond marginals of 
the Edwards-Sokal distribution are the ferromagnetic Ising model with coupling strength J and the Fortuin-Kastelyn 
random cluster model, respectively. 

Bond and spin configurations in the ferromagnet contain essentially the same information. For example, the spin- 
spin correlation function {(Jx<Jy) is equal to the probability that sites x and y are connected by occupied bonds in the 
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bond representation, 

{o'x'^y) = Probja; and y connected}. (3) 

This relationship impHes that the phase transition in the spin system is accompanied by a percolation transition in 
the bond system. 

Given a typical equilibrium bond configuration one can construct a typical equilibrium spin configuration by iden- 
tifying connected components or clusters and independently populating every spin in each cluster with one randomly 
chosen spin type. Similarly, given an equilibrium spin configuration, an equilibrium bond configuration can be con- 
structed by occupying satisfied bonds with probability 'Pfk(/3)- The equivalence between spin and bond configurations 
is the basis of the Swendsen-Wang algorithm, which proceeds by successively creating spin configurations from bond 
configurations and then bond configurations from spin configurations. It is easy to verify that this algorithm is ergodic 
and satisfies detailed balance with respect to the Edwards-Sokal distribution. Power law decay of spin correlations 
at criticality imply via Eq. ([3| that the connected components of bond configurations at criticality have a power 
law distribution of sizes. The efficiency of the Swendsen-Wang algorithm is due to the fact that the spin system is 
modified on all length scales in a single step. 

The FK representation is easily adapted to the ±J Ising spin glass. (With minor modifications, it can also be 
adapted to Gaussian and other distributions for the couplings, but we will generally not consider those in this paper.) 
The corresponding Edwards-Sokal weight is the same as given in Eq. ([T|). The A factor must still enforce the rule 
that all occupied bonds are satisfied, 

ACcr U- J) ^ { ^ '^^ ^^^'^'^ = ^ ^ JxyO-xfTy = 1 .^x 

^ ' ' ) 1^ otherwise. ^ ' 

The spin marginal of the corresponding Edwards-Sokal distribution is the Ising spin glass with couplings {Jxy}- 
Unfortunately, the relationship between spin-spin correlations and bond connectivity is complicated by the presence 
of antiferromagnetic bonds. Specifically, one has 



{<Jx<Jy) = (5) 

Prob{x and y connected by even number of antiferromagnetic bonds} 
— Probjx and y connected by odd number of antiferromagnetic bonds}. 

It is no longer the case that the percolation of FK bonds implies long range order [25]. Two spins separated by 
a large distance may usually be connected by occupied bonds but still be uncorrelated because half the time the 
connection has an even number of antiferromagnetic bonds and half the time an odd number of antiferromagnetic 
bonds. Indeed, FK bonds percolate at a temperature that is well above the spin glass transition temperature. For 
the three-dimensional Ising spin glass on the cubic lattice Fortuin-Kastelyn bonds percolate at /3fk,p ~ 0.26 [57] 
while the inverse critical temperature is /3c = 0.89 ± 0.03 [28]. Near the spin glass critical temperature, the giant FK 
cluster includes most of the sites of the system. For this reason, the Swendsen-Wang algorithm, though valid, is quite 
inefficient for simulating spin glasses. 



B. The CMR Two-Replica Graphical Representation 

A conceptual difficulty of using the Fortuin-Kastelyn representation to understand spin glass ordering is that FK 
clusters identify magnetization correlations but the spin glass order parameter is not the magnetization. Spin glass 
order is manifest in the Edwards- Anderson order parameter, which can be defined with respect to two independent 
replicas of the system, each with the same couplings {Jxy}- The spins in the two replicas are {ax} and {t^}, 
respectively, each taking values ±1. The Edwards- Anderson order parameter, qea, is defined in terms of the overlap, 

Q - A^.^'^'T.r, , (6) 

{x} 

in the limit as the number of sites Ng oo. In general, Q is a random variable whose maximum possible value is 
Qea, but in the case where (in the limit Ng —^ oo) {cTx} and {t^} are drawn from a single pure state, Q takes on only 
the single value qea- 

The two-replica graphical representation, introduced in [T3][T4]. explicitly relates spin glass order to geometry. The 
associated Edwards-Sokal joint distribution has, in addition to the spin variables, {cr^} and {t^}, two types of bond 
variables cuxy and rj^y each taking values in {0, 1}. 
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The Edwards-Sokal weight is 

>V(cr, T, LO, 77; J) = i?bluo(w)Brod(7?)A(cr, T, Cj; J)r(f7, T, 7^; J) 

where the i?'s are BernouUi factors for the two types of bonds, 



blucV 



S,.ed(^) = V'Zil - Vrcd) 



^Wb-|»;| 



and the bond occupation probabihties are 



Pbiuc = l-exp(-4/3|J|) 
Vrcd = l-exp(-2/3|J|). 



The A and T factors constrain where the two types of occupied bonds are allowed, 
A{<j,T,cj;J) = 
T{a,T,ri) = 



1 if for every xy: uj^y = 1 — » JxyO'x'^y > and JxyTxTy > 
otherwise 



1 if for every xy: rjxy = 1 (JxCTyTxTy < 
otherwise 



(7) 

(8) 
(9) 



(10) 
(11) 



(12) 
(13) 



We refer to the w occupied bonds as "blue " and the rj occupied bonds as "red ". The A constraint says that blue 
bonds are allowed only if the bond is satisfied in both replicas. The T constraint says that red bonds are allowed only 
if the bond is satisfied in exactly one replica. 

It is straightforward to verify that the spin marginal of the CMR Edwards-Sokal weight is the weight for two 
independent Ising spin glasses with the same couplings. 



W{a, T, uj, 77; J) = const x exp 



{xy} 



(14) 



C. Properties of Graphical Representations for Spin Glasses 



Connectivity by occupied bonds in the CMR representation is related to correlations of the local spin glass order 
parameter. 



It is straightforward to verify that 



(QxQy) = Probja; and y connected by even number of red bonds} 
— Probja: and y connected by odd number of red bonds}. 



(15) 



(16) 



As in the case of the FK representation, a minus sign complicates the relationship between correlations and connectivity 
but in a conceptually different way. The second term in Eq. ( 16 ) is independent of the underlying coupling in the 



model and is present for both spin glasses and ferromagnetic models. 

In the case of a ferromagnet, having a percolating cluster (or clusters) in the (single replica) FK representation 
easily shows that there is broken symmetry with respect to global spin flips. For example, one can impose plus or 
minus boundary conditions on those boundary spins belonging to FK percolating networks in the Edwards-Sokal joint 
spin-bond represenatation and these two choices of boundary conditions give two different Gibbs states for the spin 
system in the infinite volume limit. More simply, in the ferromagnetic case, the magnetization order parameter equals 
the total density of the percolating network(s), since finite FK clusters do not contribute. 

We remark, as noted in Section|l] that for ferromagnets (in the absence of boundary conditions that force interfaces), 
the signature of ordering is a single percolating cluster. For spin glasses, the situation is analogous, but more 
complicated. If there is in the CMR graphical representation a percolating blue cluster of strictly larger density 
than any other blue clusters, one can similarly show broken symmetry. Here one can impose "agree" or "disagree" 
boundary conditions between those ax and r^. boundary spins belonging to the maximum density blue network. |32j 
In the infinite volume limit, these two boundary conditions give different Gibbs states for the cr-spin system (for fixed 
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r) related to each other by a global spin flip (of a). However, in this case, it is not so easy to rigorously relate (in 
general) the overlap Q to the densities of percolating blue networks, even if one assumes that there are exactly two 
such networks with densities Di and This is because in a two-replica situation, it is not immediate that there is no 
contribution from finite (non-percolating) clusters, which would be enough to imply that Q — Di — D2. Nevertheless, 
this identity seems likely to be the case, and indeed is valid for the SK model, as we discuss in the next section of the 
paper. 

For the TRFK representation, similar reasoning shows that the occurrence of exactly two doubly-occupied perco- 
lating FK clusters with different densities implies broken symmetry for the spin system |15j and that Q should equal 



(and does equal in the SK model) the density difference. In Sec. IV C we will present peliminary numerical evidence 
that there is such a nonzero density difference below the spin glass transition temperature for the d = 3 EA ± J spin 
glass (for both the TRFK and CMR representations). 



III. THE SPIN GLASS ON THE COMPLETE GRAPH 



The spin glass on the complete graph was introduced by Sherrington and Kirkpatrick (SK) [2J. The ±J version 
of the model has couplings given by ±N^^/^ where N is the number of vertices on the graph. This scaling for the 
coupling strength insures that the free energy is extensive. In this section, we study the percolation properties of both 
the Fortuin-Kastelyn and CMR representations for the SK model. In the high temperature phase, (3 < /3c — 1, both 
the magnetization and the EA order parameter, qea, vanish. The SK solution, valid for the high temperature phase, 
yields the energy per spin, u — —(3/2. The number of unsatisfied edges minus the number of satisfied edges is equal 
to uN^/"^. Thus, letting fg be the fraction of satisfied edges, we have that 

Is-\- uN-^l^ . (17) 

In the FK representation a fraction T'fk = 1 ^ exp(— 2/3iV^^/^) w 2/3 A^^^/^ of satisfied edges are occupied. When 
will the occupied edges first form a giant cluster and how many giant clusters will coexist? The theory of random 
graphs (see |i29j ) can be used to answer this question. It is known |30j that a giant cluster forms in a random graph 
of vertices when a fraction xjN of edges is occupied with a; > 1, and that there is then a single giant cluster. This 
suggests that (single replica) FK giant clusters should form with f3 ~ xN^^I"^ when a; > 1, i.e., that the single replica 
FK percolation threshold is at 

/3fk,p = N-^'^ ■ (18) 

It also suggests that above this threshold, there should be a single giant FK cluster. 

Although the arguments just given are incomplete in that the satisfied edges were treated (without justification) 
as though they were chosen independently of each other, nevertheless the conclusions can be proved rigorously as we 
now explain. Indeed, our rigorous analysis of the much more interesting cases with two replicas will use very similar 
arguments. The idea is to obtain upper and lower bounds for the conditional probability that an edge {xqi/q} is 
satisfied, given the satisfaction status of all the other edges. If these bounds are close to each other (for large A^) then 
treating the satisfied edges as though chosen independently can be justified. 

A key point is that because of frustration, such approximate independence is impossible if one knows too much 
about the signs of the couplings. Thus, we will not condition on the sign of the single coupling Jxoyo — in f^ct we 
will consider precisely the conditional probability of that sign given the configuration of all other couplings Jxy and 
all spins ax- For the ±J model that we are considering, it is quite elementary to see first that the ratio for 
the partition functions with Jxayo = +N~^^'^ and Jxoyo = —N~^/'^ satisfies 

exp(-2/3A^-i/2) < \Z+/Z4 < exp(2/37V-i/2) , (19) 

and then that the conditional probabilities P± that Jx(,yo — ^N^-^^^ given any configuration of the other Jxy^s and 
all ax's satisfy 

g_4/3/v/]v < e-2^/^|Z_/Z+| < P+/P_ < ^^l^\Z_lZ+\ < e^"!^ . (20) 

It then follows that the conditional probabilities Ps or P„ for any edge {xqJ/o} to be satisfied or unsatisfied given 
the satisfaction status of all other edges satisfy 



(21) 
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so that 



i - 0{(3/^/N) ^ {e'^P/^ + < < {e'^P/^ + = 1 + 0{(3/^/N) . (22) 



One now obtains rigorously the same conclusions as before — i.e., ( [18^ is valid with a single giant FK cluster for 
P = Pn > xN^^/^ with any x > 1. Before proceeding to our detailed analysis of the situation with two replicas, we 
state our main conclusions: 

The threshold for TRFK percolation is 

/3trfk,p — 1 ■ (23) 

For (3 < 1, there is no giant cluster (containing a strictly positive density, i.e., fraction of sites). For f3 > I there are 
exactly two giant clusters with unequal densities. (Strictly speaking, we do not rigorously rule out the possibility that 
for some choices of (3 > 1, there might he only a single giant cluster, but we explain why that should not he so and 
also prove that a nonzero spin-spin overlap rules out the possihlity of two clusters of exactly equal density.) 
The threshold for percolation of hlue honds in the CMR two-replica graphical representation is 

/3cMR,p = N'^/^ . (24) 

Only ahove that threshold are there one or more giant clusters. The numher and density of the giant clusters is 
determined hy a second threshold which is exactly the SK spin glass critical value /3c = 1. For xN^^^^ < (3iq < 1 
with X > 1, there are exactly two giant clusters, which have equal densities; if N^/'^I3n oo, then the two densities 
are hoth exactly 1/2. For [3n > x with any x > I, there are two giant clusters of unequal densities, whose sum is 
one. (Strictly speaking, as in the case of TRFK percolation, we do not rigorously rule out the possibility that for some 
(3 > 1, there might be a single blue giant cluster, which would necessarily have density one.) 

Now we explain our analysis when there are two spin replicas a and r. For both TRFK percolation and for 
blue percolation in the CMR graphical representation, we focus on doubly satisfied edges. For the Fortuin-Kastelyn 
representation, doubly satisfied edges are occupied with probability T^trfk = [1 — exp(— 2/3A^^^/^)]^ ~ Afi'^/N. For the 
CMR representation, doubly satisfied edges are occupied with probability Vcmr = 1 — exp(— 4/3iV^^/^) ~ 4/3 7V~^/^. 
The crucial new ingredient in two-replica situations is that an edge {xy} can be doubly satisfied only if UxiyTxTy — +1 
or equivalently if o^Tx = <JyTy (and then will be satisifed for exactly one of the two signs of Jxy)- Thus, before 
proceeding as in the single replica situation, we first divide all (cr, r) configurations into two groups or sectors — the 
agree (where ax = Tx) and the disagree sectors (where Ux = —Tx). We also denote by Na and the numbers of sites 
in the sectors and denote by Da — Na/N and = Nd/N the sector densities (so that Da + Dd = 1). We note that 
the spin overlap Q is just 

X 

and that for /3</5c = l,Q^OasA^^cxD while for /3 > /3c 1, Q is nonzero, e.g., in the sense that Av{< >) > 
as N —^ oo, where Av denotes the average over couplings. 

We now proceed similarly to the single replica case, but separately within the agree and disagree sectors. Letting 
P± denote the conditional probabilities that Jxoyo — given the other Jxy^s and all cr^'s and r^-'s, we have 

within either of the two sectors that 

so that the conditional probability within a single sector Pds for xqJ/o to be doubly satisfied is (1/2) + 0{[3N~^/'^). 
For /3 < /3c, we have Da = 1/2, Dd = 1/2 (in the limit N oo) and so in either sector, double FK percolation is 
approximately a random graph model with N/2 sites and bond occupation probability ( 1/2)4/3^ iV"-'^ = 0^{N /2)~^\ 
thus double FK giant clusters do not occur for /3^ < 1. 

Blue percolation corresponds to bond occupation probability (1/2)4/3 A^~^/^ = f3N^/^{N/2)~^ and so the threshold 
for blue percolation is given by (24). But now there are two giant clusters, one in each of the two sectors, and they 
are of equal density for /3 < /3c = 1 since Da — Dd. On the other hand, for /3 > /3c, Da ^ Dd and the two giant 
clusters will be of unequal density. In fact, since fiN^/"^ oo for (3 > (3c (indeed for any fixed (3 > 0), it follows 
from random graph theory that each giant cluster occupies the entire sector so that Da and Dd are also the cluster 
percolation densities of the two giant clusters. 

In the case of two-replica FK percolation for (3 > (3^, let us denote by D^ax and the larger and smaller of 

Da and Dd, so that Dmax + Dmin = 1 and Dmax — Dmin = Q- Then for (3 > (3c, the bond occupation probability 
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in the larger sector is 0^{N/2)~^ — Dmax{DmaxN)~^ with 20^D„iax > 1 and there is a (single) giant cluster in 
that larger sector. There will be another giant cluster (of lower density) in the smaller sector providing 20^Dmin 
{— /3^(1 — Q)) > 1. Since Q < Qea, for this to be the case it suffices if for f3 > /3c, 

qEA<i-^ . (27) 

The estimated behavior of qea both as /3 — > 1+ and as /3 — > cx) [5] suggests that this is always valid. In any case, we 
have rigorously proved that there is a unique maximal density double FK cluster for [3 > (3c- 

IV. NUMERICAL SIMULATIONS 

In this section we describe numerical simulations of the Edwards-Anderson spin glass in three dimensions to test 
ideas about the percolation signature for spin glass ordering. For comparison, we also describe simulations of spin 
clusters for the 3-D ferromagnetic Ising model. 

A. Methods 

We carried out simulations of the ± J Ising spin glass using a Monte Carlo method that combines CMR cluster 
moves, Metropolis sweeps and parallel tempering (replica exchange). A similar scheme was used in a study of the 
random field Ising model [53]. The cluster moves are closely related to the replica Monte Carlo algorithm introduced 
by Swendsen and Wang [TTJ [THl [H] and developed in |5T1 [22 [2S] . The combination of two-replica cluster moves and 
parallel tempering was first introduced by Houdayer |21j . The new ingredient in the present algorithm is that all of 
the degrees of freedom available in the CMR representation are used. The additional degree of freedom is incorporated 
in "grey" moves, described below. 

The parallel tempering component of the algorithm works with R pairs of replicas at equally spaced inverse temper- 
atures. Standard temperature exchange moves arc carried out between one of the two replicas at one temperature and 
at one of the neighboring temperatures. The CMR cluster moves begin by identifying all singly and doubly satisfied 
bonds and occupying them with probabilities, T^biuo = 1 — exp(— 4/3) and T^rod = 1 — exp(— 2/3), respectively. Bonds 
that are not satisfied in either replica cannot be occupied. The occupied bonds determine blue and grey clusters. Sets 
of sites connected by blue bonds and singletons are considered to be blue clusters. Sets of sites connected by blue or 
red bonds are considered to be grey clusters. The cluster moves proceed as follows. For each grey cluster a random 
bit determines whether to perform a grey move or not. If a grey move is chosen, the sign of Q in each blue cluster in 
the grey cluster is reversed. Next, a random bit determines which of the two spin states to put each blue cluster in 
given its Q state. For example, if Q = 1 in a given blue cluster then, with equal probability, the spin state of a given 
site in the cluster is either (-I--I-) or ( ). 

The two-replica cluster component of the algorithm satisfies detailed balance with respect to the Edwards-Sokal 
weight for the CMR graphical representation. In addition, the two-replica cluster component of the algorithm is, by 
itself, ergodic. There is a non- vanishing probability that any given site is a singleton cluster and is flipped to any of 
the four spin states. Thus, there is a non-vanishing probability of a transition from any spin configuration for the 
pair of replicas to any other spin configuration in a finite number of steps. A single pair of replicas will eventually 
approach equilibrium under two-replica cluster moves. However, for reasons that will become clear in Sec. |IV C| the 
equilibration by two-replica cluster moves alone is very slow in three dimensions. Thus we supplement these moves 
with both temperature exchange moves and Metropolis sweeps. 

The presence of very long lived metastable states makes it difficult to gauge whether a spin glass simulation has 
reached equilibrium. Here we measure the time it takes for a spin configuration, originally at the highest simulated 
temperature, to diffuse by replica exchange moves, to the lowest temperature. If the entire set of replicas is in 
equilibrium and if the replica pair at the highest temperature is rapidly equilibrated, then this first passage time 
estimates the time it takes to obtain an independent sample at the lowest temperature. We assume that the mean 
first passage time is comparable to the equilibration time for the full set of replicas though it is conceivable that 
equilibration time is much longer than the mean first passage time. For the 12^ system, the largest system studied 
here, the mean first passage time is of the order of one hundred MC sweeps and does not vary greatly from one 
realization to another so we believe that the system is well equilibrated. 

The two-replica cluster moves complicate the ability to keep track of a single spin configuration as it diffuses in 
temperature space. If there are two giant clusters and, in one of the replicas, both or neither of the giant clusters 
are flipped then the identity of the spin conflguration is unaffected (though it may have suffered an overall spin flip). 
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On the other hand, if one giant cluster is flipped and the other not then the spin configurations of the replicas are 
swapped. Below the CMR percolation transition, this same rule is applied to the two largest clusters but the identity 
of the spin configuration is effectively lost in one two-replica move. 

B. Improved Estimators 

One advantage of cluster algorithms in data collection is the existence of improved estimators [12^ in the graphical 
representation. For example, in the Swendsen-Wang algorithm, one can obtain the magnetization and magnetic 
susceptibility from the cluster configurations. The magnetization is the average size of the largest cluster and the 
susceptibility is proportional to the sum of the squares of the cluster sizes. Since each occupied bond configuration 
corresponds to many spin configurations, the variance of observables measured from the bond configurations is less 
than for the same observables measured in the spin configuration leading to smaller error bars for the same amout 
of computational work. Improved estimators exist within the CMR representation for the spin glass order parameter 
and susceptibility. For example, the order parameter Q can be obtained from the percolating grey cluster if it exists 
and is unique. In particular, the local order parameter summed over the sites of the percolating grey cluster 
should equal the Q of the whole system since the contributions of small grey clusters vanishes after averaging over 
the possible spin states of these clusters. 

C. Simulation results 

We simulated the three-dimensional ± J Edwards- Anderson model on skew periodic cubic lattices for system sizes 
6"^, 8'^, 10^ and 12^. For each size we simulated 20 inverse temperatures equally spaced in the range (3 = 0.16 to 
(3 = 0.92. Since there are two replicas for each temperature, the total number of replicas simulated was 40. A recent 
estimate of the phase transition temperature of the system is /3c = 0.89 ± 0.03 [28]. For each size we simulated 100 
realizations of disorder for 50,000 Monte Carlo sweeps of which the first 1/4 of the sweeps were for equilibration and 
the remaining 3/4 for data collection. One Monte Carlo sweep consists of a cluster move for the pair of replicas at 
every temperature, a Metropolis sweep for each replica and a temperature exchange attempt for each temperature. 
The quantities that we measure are the fraction of sites in the largest blue cluster, Ci and second largest blue cluster, 
C2 and the number of blue CMR wrapping cluster, wcmr, and the number of TRFK "wrapping" clusters, wtrfk- A 
cluster is said to wrap if it is connected around the system in any of the three directions. 

Figure [T] shows the average number wcmr of CMR blue wrapping clusters as a function of inverse temperature 
(3. The curves are ordered by system size with largest size on the bottom for the small f3 and on top for large (3. 
The data suggests that there is a percolation transition at some /3cMR,p- For (3 > PcMR.p there are two wrapping 
clusters while for (3 < (3cmk,p there are none. Near and above the spin glass transition at (3c ~ 0.89 the expected 
number of wrapping clusters falls off but the fall-off diminishes as system size increases. This figure suggests that 
in the large size limit there are exactly two spanning clusters near the spin glass transition both above and below 
the transition temperature. Figure [2] is a magnification of Fig. [TJnear the CMR percolation transition. The crossing 
points identify the percolation transition as Pcmr,p ~ 0.275. This value is close to the FK percolation transition for 
the ±J EA model /3fk.p ~ 0.26 reported in 1^. A more careful study would be needed to test the hypothesis that 
PcMR,p > (3fk,p- 

Figure [3] shows the fraction of sites in the largest CMR blue cluster, Ci, second largest CMR blue cluster, C2 and 
the sum of the two, Ci + €2- The middle set of four curves is Ci for sizes 6"^, 8'^, 10'^ and 12"^, ordered from top to 
the bottom at /3 = 0.5. The bottom set of curves is C2 with systems sizes ordered from smallest on bottom to largest 
on top ai (3 — 0.5. The difference between the fraction of sites in the two largest clusters, Ci — C2 is approximately 
the spin glass order parameter. As the system size increases, this difference decreases below the transition suggesting 
that Ci — C2 for /3 < /3c in the thermodynamic limit. On the other hand, the sum of the two largest clusters is 
quite constant independent of system size. Near the transition, approximately 96% of the sites are in the two largest 
clusters. 

The large fraction of sites in the two largest clusters makes the CMR cluster moves inefficient. If all sites were in 
the two largest clusters then the cluster moves would serve only to flip all spins in one or both clusters or exchange 
the identity of the two replicas. Equilibration depends on the small fraction of spins that are not part of the two 
largest clusters. One of the reasons that bond diluted spin glasses are more efficiently simulated using two-replica 
cluster algorithms is the smaller fraction of sites in the two largest clusters. We have carried out simulations on the 
same bond diluted Ising spin glass studied by Jorg [53 . This model has 55% of the couplings set to zero and 
45% set to ±1. Near the phase transition, we find that only 87% of the sites are contained in the two largest clusters 
instead of the 96% found in the undiluted spin glass. 
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FIG. 1: Average number of wrapping CMR clusters, wcmr vs. /3 for the 3D EA model. 




FIG. 2: Same as Fig. [l] magnified near the CMR percolation transition 

Figure [4] show the average number of wrapping TRFK clusters wtrfk as a function of inverse temperature. The 
largest system size is on the bottom for the small (3 and on top for the large 13. As for the case of CMR clusters, 
the data suggests a transition at some /3trfk,p from zero to two wrapping TRFK clusters. Although the number of 
TRFK wrapping clusters is significantly less than two for all fi and all system sizes, the trend in system size suggests 
that it might approach two for large systems and (3 > /3trfk,p- Figure |5] shows a close up of the transitions region 
and the crossing points give the inverse percolation temperature as /Strfk.p ~ 0.565 

The percolation signature for both CMR and TRFK clusters is qualitatively similar in three dimensions. In both 
cases two giant clusters with opposite values of the local order parameter appear at a temperature substantially above 
the phase transition temperature. In the high temperature phase, the two giant clusters have the same density and 
the phase transition is marked by the onset of different densities of the two clusters. This scenario is not unlike what 
is expected in the ferromagnetic Ising model for the graph defined by satisfied bonds. On the cubic lattice in the high 
temperature phase we expect two giant clusters of up and down spins of equal density. The ferromagnetic Ising phase 
transition is marked by the onset of different densities of the two clusters. Figure [6] shows the largest and second 
largest cluster of satisfied bonds and the sum of the two for the ferromagnetic Ising model. The system sizes are the 
same as for the spin glass simulations: 6'^, 8^, 10^ and 12^. The vertical axis is located at the critical temperature. 
This figure is qualitatively similar to the results for the two largest clusters in the CMR representations. In both 
cases, for these system sizes, the phase transition is quite rounded in the sense that a difference in density develops 
well before the transition and the transition itself cannot be identified by looking at the size of the clusters. The 
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FIG. 3: Ci (middle set), C2 (bottom set) and Ci +C2 (top set) vs. [3 for the CMR graphical representation for the 3D EA model. 
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FIG. 4: Average number of doubly occupied wrapping Fortuin-Kastelyn clusters, ^Ftrrk vs. /3 for the 3D EA model, 
difference in the density of the two clusters is thus not a sharp indicator of the phase transition for small system sizes. 

V. DISCUSSION 

In this paper we have proposed a new percolation-theoretic approach towards understanding the nature of the spin 
glass phase transition. It is based on the Fortuin-Kasteleyn [UlTj random cluster method (and some variants), which 
has been enormously useful in analyzing phase transitions in ferromagnets, but had much less impact on systems such 
as spin glasses until now (see, however, [T51E^E5] ). 

There are a number of advantages to our approach. First, and most obviously, it sheds new light on the nature 
of the spin glass phase transition, particularly its geometric aspects. For example, it provides at least a qualitative 
explanation of why the EA spin glass on a simple planar lattice doesn't have broken spin flip symmetry at positive 
temperature (see below). Second, it indicates a possible new framework towards an eventual rigorous proof of an EA 
spin glass phase transition (at least in sufficiently high dimensions), while providing a basis for numerical work to 
explore, and hopefully resolve, the issue of the lower critical dimension. Finally, it helps to emphasize fundamental 
differences between phase transitions in spin glasses as opposed to more conventional systems such as ferromagnets. 
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FIG. 6: The size of the largest cluster of satisfied bonds (middle set), the second largest cluster (bottom set) and the sum of 
the two largest clusters (top set) vs. /3 for the three-dimensional ferromagnetic Ising model. 

Two different representations, each involving two replicas, were used to apply an FK type formalism — the Chayes- 
Machta-Redner(CMR) |T3j E] representation and the two-rephca FK (TRFK) representation previously considered 
by Newman-Stein [15 . It is likely that other representations can also be used, as long as they involve the overlap 
of independent replicas. While various details will differ, as described in the text, the essential — and somewhat 
surprising — feature appears to be that the spin glass transition coincides with the emergence of percolating clusters 
of unequal densities. 

Numerical results for the rf = 3 EA spin glass seem to indicate that this occurs, as T is lowered below T^., as the 
breaking of symmetry in the equal densities of both doubly occupied TRFK and blue CMR clusters that already 
percolate above the transition temperature. For the SK model, on the other hand, what occurs just above Tc is 
representation-dependent: in the TRFK representation, there is no doubly occupied percolation at all above T^, while 
in the CMR representation there are two equal-density blue clusters just above T^, similar to the situation in the 
c? = 3 EA model. This difference in behavior above Tc may arise from the peculiarities of the SK model, and a similar 
representation-dependence may not occur in short-range models. 

Finally, we speculate about the nature of the lower critical dimension. Our numerical results are consistent with 
prior studies [551 IS] indicating the appearance of broken spin-flip symmetry in the EA model in three dimensions. 
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If the percolation signature scenario proposed here is correct for short-range models, it would help explain why there 
is no spin glass transition leading to broken spin- flip symmetry on simple planar lattices: two dimensions does not 
generally provide enough "room" for two disjoint infinite clusters to percolate. However, a system that is infinite 
in extent in two dimensions but finite in the third might be able to support two percolating clusters, with unequal 
densities at low temperature. This and other possibilities will be explored in future work. 
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